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DECISION  INTERVAL  AND  SIGNAL 
DETECTABIUTV  IN  A  VIGILANCE  TASK] 

JANE  F.  MACKWORTH 
Defence  Reteorch  Medical  Laboratories,  Toronto 

Abstbact 

This  paper  discusses  the  effect  of  the  assumed  decision  interval  on  the  measure¬ 
ment  of  d'.  Previous  experiments  have  revealed  a  decrement  in  the  detectability 
(d')  of  signals  during  a  particular  vigilance  task  involving  the  detection  of  a  brief 
pause  in  the  movement  of  a  clock  hand.  In  order  to  measure  the  false  alarm  proba¬ 
bility',  Ss  were  required  to  make  a  decision  once  every  five  sec.  as  to  whether  or  not 
thcie  liad  been  a  signal  in  the  previous  five  sec.  In  this  paper  Ss  were  required  to 
respond  as  soon  as  they  saw  a  signal,  and  it  was  assumed  that  the  decision  interval 
was  the  signal  duration.  The  thirty-fold  change  in  assumed  decision  interval  produced 
very  little  change  in  the  decrement  in  d’  during  the  run.  It  is  therefore  concluded 
that  the  length  of  the  assumed  decision  interval  was  not  a  laritical  factor  in  deter¬ 
mining  changes  in  d'  during  the  continuous  clodc  task. 


It  has  been  beported  ( Mackworth  and  Taylor,  1963)  that  in  a  particular 
vigilance  task  a  decrement  was  observed  in  the  detectability  (d')  of  the 
signals  during  the  course  of  the  run.  In  this  task  the  subject  was  required 
to  detect  brief  pauses  in  the  otherwise  continuous  movement  of  a  clock 
hand.  The  clock  face  was  divided  into  five-secontl  intervals  by  white 
marks,  and  the  subjects  were  told  that  tho-e  would  never  be  more  than 
one  signal  in  any  one  five-second  interval.  Since  the  signals  could  occur 
at  any  moment  within  each  five-second  interval,  the  task  eflFectively 
required  continuous  observation. 

In  the  computation  of  d',  it  is  necessary  to  determine  two  parameters 
(Swets,  Tanner,  and  Birdsall,  1961).  These  are  the  probability  that  the 
subject  will  claim  to  have  detected  a  signal  when  one  was  in  fact  pre¬ 
sented,  and  the  probability  that  he  will  claim  a  detection  when  no  signal 
was  presented.  When  the  task  is  divided  into  discrete  intervals  of  time, 
each  of  which  contains  a  single  presentation  either  of  a  signal  or  of  no 
signal,  then  computation  presents  no  problem;  the  numbers  of  events 
“signal”  and  “no  signal”  are  uniquely  known.  If  the  task  is  continuous, 
however,  the  number  of  events  “no  signal”  is  not  known.  Egan,  Green¬ 
berg,  and  Schulman  (1961)  suggested  one  way  of  avoiding  this  problem; 
their  method  involved  the  assumption  that  the  correct  detection  prob¬ 
ability  is  a  power  function  of  the  false  alarm  probability. 

Mackworth  and  Taylor  used  a  different  approach.  The  subjects  were 
told  to  respond  only  at  the  end  of  each  five-second  interval,  when  the 
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clock  hand  passed  a  white  mark.  In  this  way  the  overt  decision  rate  was 
limited  to  one  decision  every  five  seconds.  In  the  computation  of  d'  the 
false  alarm  probability  was  obtained  by  dividing  the  number  of  false 
positive  reports  by  the  number  of  five-second  intervals  that  did  not  in 
fact  contain  a  signal. 

Since  the  signal  was  very  .short  (0.2  second)  compared  with  the  overt 
decision  interval  of  five  .seconds,  it  is  doubtful  whether  the  entire  interval 
was  treated  as  a  unit  by  the  subject  when  deciding  whether  or  not  a 
signal  had  been  present^.  An  extreme  alternative  hypothesis  is  that  the 
subject  made  a  decision  regarding  the  existence  of  the  signal  in  each 
successive  0.2-second  interval.  According  to  this  hypothesis,  the  signal 
would  be  reported  only  if  some  rather  high  criterion  were  exceeded  in 
at  least  one  of  the  0.2-second  intervals  during  the  five-second  period.  If 
this  was  the  case,  the  detectability  levels  computed  on  the  assumption 
of  12  decisions  per  minute  were  much  too  low,  since  the  estimated  false 
alarm  probabilities  were  too  high  by  a  factor  of  25. 

Two  questions  arise  from  these  considerations.  First,  are  the  changes 
in  detectabihty  found  by  Mackworth  and  Taylor  (1963)  and  also  found 
in  later  experiments  (Mackwoi+h,  1964, 1965)  dependent  on  the  assump¬ 
tions  made  in  calculating  the  probabilities  of  false  alarms,  and  secondly, 
would  these  changes  in  detectability  be  found  if  the  subjects  were 
allowed  to  respond  as  soon  as  they  detected  a  signal? 

In  the  present  experiment,  the  detectability  of  the  pause  in  the  move¬ 
ment  of  the  clock  hand  was  varied  in  two  ways.  The  marking  on  the 
clock  face  was  varied,  and  the  duration  of  the  pause  was  changed. 
Suitable  manipulation  of  these  two  variables  can  yield  a  constant  detec¬ 
tion  probability  with  different  signal  durations;  Mackworth  (1963) 
showed  that  the  presence  of  one  or  two  white  marks  on  the  clock  face 
substantially  increased  correct  detections  of  pauses  of  a  given  length.  In 
some  conditions,  discussed  in  the  present  paper,  .subjects  were  required 
to  report  only  at  the  end  of  each  five-second  interval.  In  other  conditions, 
they  were  free  to  report  at  any  time.  With  free  response,  false  alarms 
could  conceivably  be  made  as  fast  as  the  subject  was  able  to  respond, 
and  decisions  as  fast  as  signals  could  be  presented.  Here  the  “natiu-al" 
decision  interval  is  the  length  of  the  signal,  either  0.17  or  0.25  second. 
Values  for  d'  were  calculated  using  both  the  “natural*  decision  rate  and 
a  “transformed”  decision  rate  in  order  to  see  what  would  happen  to  d' 
when  these  different  methods  of  calculation  were  used. 


Method 

For  the  free-respoiise  situation,  two  clock  faces  were  used.  One  was  completely 
black,  the  other  had  a  thin  white  mark  at  the  top  and  another  at  the  bottom.  Groups 
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of  Mven  housewives  were  tested  simultuteously,  each  S  sitting  in  an  isolated  boodi 
in  dim  light  and  watching  the  image  of  the  clodc  on  a  T.V.  monitoi.  Croup  1  was 
tested  with  the  blade  clock  face  on  two  successive  days.  They  were  required  to 
detect  a  signal  consisting  of  a  pause  of  0.25  sec.  duration  in  die  movement  of  the 
clock  hand.  Croup  2  was  tested  with  the  dodt  face  showing  two  white  marks  and 
was  required  to  detect  a  signal  of  0.17  sec.  duration.  Th^  signal  lengths  were 
chosen  to  give  approximately  the  same  probability  of  detection. 

The  Ss  were  given  a  practice  run  of  ten  signals  in  approximately  three  miiu, 
during  which  a  red  light  was  used  to  indicate  to  S  that  she  had  missed  a  signal  All 
Ss  detected  at  least  half  the  signals  in  this  practice  period.  Immediately  after  this 
practice  they  were  told  that  the  main  run  would  begin,  and  auditory  ixrise  of  68  db 
was  introduced  into  each  boodi  to  obscure  external  noises.  There  were  180  signals 
in  die  hour’s  run  widi  15  signals  in  each  five-min.  period.  The  interval  between 
signals  varied  from  10  to  30  sec.  The  were  instructed  to  respond  as  soon  as  they 
saw  a  signal,  and  they  were  encouraged  to  moke  a  response  if  they  were  doubtful  as 
to  whether  a  signal  had  occurred. 

Responses  were  recorded  on  an  Esterline-Angus  20‘pen  recorder,  and  any  response 
widiin  two  sec.  after  pr^entation  of  a  signal  was  scor^  as  a  correct  response.  Hence 
there  was  an  average  of  54  sec.  per  minute  during  adiidi  responses  were  incorrect 
Since  there  were  few  false  alarms  there  was  seldom  any  doubt  as  to  whether  or  not 
a  response  was  cocrect 

RESXn.TS 

Table  I  shows  the  percentage  of  correct  detections  and  the  percentage 
of  false  alarms  for  Groups  1  and  2.  These  were  calculated  on  the  assump¬ 
tion  that  a  decision  was  made  every  0.25  second  by  the  subjects  of 


TABLE  I 

Percentage  of  Sksnaus  Detected  and  of  Faise  Alarms,  with  Free  and 
Restiucted  Responses,  and  Cloce  Faces  with  Dtfferent  Numbers  of  Mares 


Period 

(min.) 

%  Detection 

%  False  alarms 

Croup  1 

Marks  0 

2 

2 

3 

12 

4 

12 

Croup  1 

Marks  0 

2 

2 

3 

12 

4 

12 

0-10 

72 

76 

79 

70 

0.18 

0.3 

4.8 

1.4 

10-20 

63 

69 

69 

59 

.13 

.4 

4.0 

1.2 

20-30 

57 

69 

62 

45 

.11 

.4 

3.7 

0.8 

30-40 

56 

62 

59 

46 

.14 

.5 

3.8 

1.9 

40-50 

56 

59 

42 

.26 

.4 

1.0 

50-60 

59 

58 

44 

.16 

.5 

1.4 

Groups  1  and  2,  free  response. 

Croups  3  and  4,  maximum  12  responses/min. 

Signm  duration.  Croup  1;  0.25  sec.;  Croups  2,  3,  4;  0.17  sec. 


Group  1,  and  every  0.17  second  by  those  in  Group  2.  It  can  be  seen  that 
Group  2  gave  many  more  false  alarms  than  Group  1,  and  also  that  there 
was  no  consistent  change  in  false  alarm  rate  during  the  run. 
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Discussion 

Table  I  also  shows  data  from  control  groups  (3  and  4)  used  in  other 
experiments  (Mackworth,  1963a,  and  unpublished  data).  These  subjects 
were  tested  with  a  clock  showing  twelve  white  marks  and  were  instructed 
to  respond  only  when  the  clodc  hand  passed  the  white  mark  which  ended 
the  five-second  interval  in  which  they  had  seen  a  signal  The  signal  dura¬ 
tion  for  these  subjects  was  0.17  sec.  The  decision  interval  was  assumed 
to  be  5  seconds,  and  rince  there  were  180  signals  an  hour,  as  for  Groups 
1  and  2,  in  each  minute  there  was  an  average  of  nine  decision  interv^ 
which  did  not  contain  signals. 


Ficviuc  1 
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Figure  1  shows  values  for  d'  obtained  from  tables  (Elliott,  1964).  The 
curves  drawn  with  solid  lines  represent  the  values  for  d'  obtained  from 
the  false  alarm  percentages  shown  in  Table  L  These  values  have  been 
plotted  against  the  time  on  task  shown  on  a  square  root  scale.  This  scale 
has  been  found  appropriate  for  a  wide  variety  of  tasks  involving  con- 
tiimous  observation  (Mackworth,  1964b). 

It  can  be  seen  that  the  different  methods  of  limiting  responses  and 
calculating  the  decision  rate  have  a  ccmsiderable  effect  on  the  absolute 
values  of  d',  but  very  htde  effect  on  the  rate  at  which  d'  decreases  during 
the  run.  It  is  probable  that  the  two  decision  intervals  which  have  been 
employed  represent  two  extreme  assumptions.  Egan,  etal.  { 1961 )  demon¬ 
strated  with  the  method  of  free  response  that  nearly  all  responses  to 
actual  signals  occurred  within  one  second,  though  the  onset  of  response 
was  displaced  slightly  with  different  criterial  levels.  By  two  seconds  after 
the  signal,  the  responding  rate  had  returned  to  the  base  line  that  repre¬ 
sented  the  false  alarm  rate.  Thus  it  is  probable  that  the  “true”  decision 
interval  lies  somewhere  be^veen  the  two  extremes  used  here. 

Figure  1  also  shows  what  happens  tc  d'  when  the  assumptions  about 
the  decision  rate  are  changed,  without  changing  the  actual  experimental 
conditions.  The  results  from  Groups  1  and  2  (free  response)  were  re¬ 
calculated  on  the  basis  of  a  decision  interval  of  five  seconds.  This  is  a 
purely  theoretical  calculation,  since  it  is  unlikely  tliat  subjects  actually 
operated  at  such  a  slow  rate  when  there  was  no  r.idication  to  them  that 
they  should.  The  results  of  the  calculations  are  shown  in  the  lower  broken 
lines  in  Figure  1.  For  Group  1,  there  was  a  decrease  of  0.4  unit  of  d' 
from  the  first  to  the  last  ten  minutes  of  the  run,  and  this  decrease  is  the 
s.'une  whether  the  calculation  is  made  on  the  basis  of  a  decision  interval 
of  0.17  second  or  of  five  seconds.  Group  2  shows  an  increased  decrement 
in  d'  during  the  run  with  the  longer  decision  interval.  There  was  a 
decrease  of  0.65  imit  of  d'  when  measured  with  the  decision  interval  of 
0.17  second  and  a  decrease  of  0.86  unit  during  the  run  when  calculated 
with  an  assumed  decision  interval  of  five  seconds.  This  group  had  an 
unusually  high  false  alarm  rate.  The  false  alarm  ^^ercentage  for  the  last 
ten  minutes  of  the  nm  was  19  per  cent,  when  the  five-second  decision 
interval  was  used  as  a  basis  for  calculation.  In  other  words,  two  false 
alarms  were  qiute  likely  to  occur  within  one  five-second  period.  Even  so, 
the  decrement  in  d'  from  the  first  to  the  fifth  ten  minutes  of  the  run  only 
shows  a  10  per  cent  difference  wdth  the  two  methods  of  calculation. 

A  similar  transformation  has  been  made  with  Groups  3  and  4,  When 
the  decision  interval  is  taken  as  the  signal  duration,  that  is  0.17  second, 
the  values  of  d'  obtained  are  shown  by  the  upper  broken  lines.  Again 
the  transformation  causes  very  little*  change  in  the  difference  between 
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the  first  and  last  ten  minutes  of  che  run.  Croup  3  shou's  a  change  from 
0.46  to  0.51  unit  of  d',  and  Croup  4  shows  a  change  from.  0.68  to  0.59 
imit,  when  the  assumed  decision  interval  is  decreased  to  0.17  second. 

There  are  some  changes  in  the  rebtive  positions  of  the  curves  when 
the  assumed  decision  interval  is  changed.  One  reason  for  this  is  that  the 
large  differences  in  false  alarm  rates  result  in  sampling  different  parts  of 
the  probability  curves  used  for  the  calculation  of  d'.  The  only  curves  that 
show  an  actual  reversal  of  relative  levels  are  those  for  Croups  3  and  4. 
These  two  groups  received  the  same  experimental  conditions.  Croup  2 
received  the  same  signal  as  Croups  3  and  4,  but  was  shown  two  white 
marks  on  the  clock  as  exposed  to  twelve  for  Croups  3  and  4.  This  differ¬ 
ence  in  display  was  expected  to  make  a  difference  in  detectability. 

It  can  be  concluded  that  the  assumed  decision  interval  can  be  widely 
varied  with  a  thirty-fold  change,  with  little  effect  on  the  decrement  in  d' 
during  a  run.  Nor  does  it  seem  to  make  much  difference  to  the  rate  of 
decrement  whether  the  subject  is  restricted  to  twelve  responses  per 
minutes  or  allowed  to  respond  freely.  It  therefore  foUows  that  the 
changes  in  d'  described  in  the  various  papers  mentioned  above  are  not 
dependent  on  possible  artifacts  introduce  by  the  assumed  decision 
intervaL 


RisuMi: 

E£Fet  produit  par  I’intervalle  hypoth^tique  de  d^dsion  nir  k  meiuie  de  d'.  Des 
experiences  anterieures  ont  mootie  une  di^nution  de  la  teperabilite  (d')  des  rignaux 
pendant  une  tAche  particuliere  d'attention  tanpliquant  le  reperage  d’un  airlt  br?f  au 
cours  du  mouvement  d'un  aiguille  chronometrique.  Pour  qu’il  soit  possible  de  mesurer 
la  probabilite  de  fausses  aleites,  les  sujets  etaient  obliges  de  decider  une  fois  par  cinq 
secoTHies  s’il  s'etait  produit  ou  non  un  signal  pendant  les  dnq  secondes  ecouiees. 
Dans  retude  id  rapportee,  les  sujets  doivent  repondre  d^s  qu’ils  voient  un  signal  et 
Ton  assume  que  I’intervalle  de  decision  est  la  duree  du  signa'..  La  modification  (A  30 
niveaux)  de  I’intervalle  hypothetique  de  decision  a  trAs  peu  d’effet  sur  la  diminution 
de  d’  au  cours  de  la  serie.  On  peut  done  en  conclure  que  la  longueur  de  I’intervalle 
hypothetique  de  decision  n’^ot  pas  un  facteur  crudal  dans  la  modification  de  d'  pen¬ 
dant  la  tiche  consideree. 
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